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PREFACL ^ 



Tins report is a protessional paper presented in the svmposiuni entitled, 'Human 
Rcsoura^s and Lngmeering Design Qritena " which was chaired b\ Dr Harry L.Snyder, 
Chaifnian for Division, 21, Tlie Societv of Engineering Psychologists, of the Amencan 
Psycholoiucal Association The syrfiposuim was conducted dimng tl>e 83rd Annual 
Convention, (Chicago, Illinois, 30 August- 3 September 1975, Preparation of the paper 
was supported b> the Advanced Systems Division, Air Force Human Resources 
Laborator> , N\ nght-Patterson AFB, Ohio Tins support was provided under Project 1 124, 
Human Ro$v>urce$ in Aert)space Development and Operations 
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\\\ MAN RLSOltoS AS bNGiNLb'*RING DESlGN.CRITERiA ' 

• ' / ^ • • ^ ^ 

lNTRODl.mON 

Tlie'develupnYent'ol the human skills required tu utilise the maalimes produced by mm has been a 
pmblenr throuaiioiit 4lic historv of tecluuTlog^. A^i^mg as technolog) \Cas changing slowly, the problem 
was 1)01 sonous Wth the shift 'troni cfaf; e.xpjnen.ce to science as the basis for technology, the problem of 
-ni^Whing skills required with ^'Uh a\aaaye i^ecame significant (Singer, flolnjvard. Hall.& Wilhams. 1958) 

Reaction. Prediction, and ControU 

Tlie importance of this problem has-been recogni^d by the n-ulitar>' services Ecksirand, Ask'ren. and 
S-nvder ( IVb'^) traced the history ot planning for human resuurcesj^'ith respect to mditary weapon systenis 
Originally, skilled- manpowet-ior military systems were pruvid<^er the hardware was delivered to the 
luili'iary unit Personjiel selection and training was accoiT)phshed as>i^i reaction to the demands ot 
the equipn^cQt 4\irrenU> (U)e)7. and .till true'^in 19-^5) human resour^^^^lanning is charactenzed by 
anah'^^s whiUi imdui manpovver needs early dunng svstem development Tm^^Y prediction allows the 
sefcction ot personnel, and the plajnnmg for trainmg to begin betore the hard>:K4 is delivered to the 
(Operational unit . ' * ^ ^ 

Ukstrand ei al then postulated that the nexr phase of human resources pi anning^Il be a 

confr'^llina or s%h sij^n Inwrdi r/rvrphase. in whic.h.data on person^nefand^a^iimng factors will become > 
criteria, and inllacnce the characteristics ot the hardware of new svstems. 
* hecausc contruf -tends to toUow pTediaioh in scienLC. arKii>3rtiv-be^.uisc^of the need to resTtstft^r reduce 
'the TvipidK mcitasTing dc^llar co'sts ot the human side of nuhtary systeii 

Purpose of t^s Paper • ^ / ^ 

s t udiesJnj]ie_aiUii^^ 




'nui»4^Ji^r sumniari/es the rcsultsAU a number 

been an auempt to develop a techinrW>7^hich to'tid iniplenient ihe design inte+Uiiiina^ 
rosM^ucc> planning \ igiu studies are hnetly\lcsLribed. llie results aYc integrated tof rovide the bcgmningoC 
a nctlioai'lt^gy tor using haim^ resources data as critena In ^i^ineernig design 

Thi,s w.)rk is p?i^t ot a Ltrgcr eltort bv the -Vir I orLC^ji^aok^^^ nietlu)ds, nu. dels, and data tor iisin^g 
huTuan resources and ivrsonnefcost LaJ^rs in the development cy de of jicvv s\ stems 1 x am pies of other 
.•if-.rts iir Hhs i^uuMal area mJude ^tidt.c% h> lint/, I^a^v, liopper, and Potenipa ( 1^)73 ). and Mahcr^and 
N Ilk ( r'"4), \skrcn and I mt/ ^ );:wMi,Pote!T.pa. I int/. and I u^kcw ( l^)7>) also touch on tlie,broader 



W WW IK.IU Sit !)!IS\ 

( (UKeptuaii/ation ot 'the design iiitoiactvui pl^'se heu.in^n VH^(\ The Dhjcctivcs and the tirst ettorts at 
deljnifi^: the elementN ot the pr«>hkMn were reported m'l Lk^lrandet al ( TU)'^) Hie tlrst exjXMinientai study 
was ^vrtormod slmnly ihereattcr I Meister. Sulhvan.t!t A^kren. 1%?^) 

I irst Studv 1^ . ' > ' * . 

llie purpose ui the tust ^tud\ vv^^s t^> detennine thetMfe^i on .s\sfeni design ot using in.uip'wer data 
as d.csivn ^onNtraints V sccondar\' oh|t<Ltivc was to detcintine under what Loiulilions and in what tornr 
tlieso da-ia should ho used to have ni.rximutii etlcct on design I^|uipnient data. nian}n)ucr quantitv .uul skill 
levot data and 't.isk uutormation data vvhuh vvcre produced during devclopnient ol a balltstiL nussile 
suhsvsicni were presf^Hted to st\ exjx'riena'd Mesign eiu'incers Ilicy were instructed to "design' the 
subs\stLMn riie emuneers were required to aeate st.hein.itks, equipment dcstriptmns and drawings, ccMUrol 
panel Liv outs, ('^fxratiorj preoceduresraiul bills ot material 
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It Was fouf!d that manpower quantity and personnel skill level constraint data impact the equipment 
configuration. The engmeers were responsive pnmarily to the mputs that were framed as design 
requirements The results also indicate that if manpower and taskdataT^re to be Incorporated into design, it 
is necessary to supply these inputs to the engineer as design requiremenfsinhis initial statement Of work. 

Second Study ^. , . . s ^ ^, 

' The second study (Meister, Sullivan, IFinley, & Askren, 1969a) was a fu/th^r test of the effect on 
design of using manpower quantit> and skill Jevel data as design constraints. The-stUdy investigated whether 
the amount of data given to the engineer, and:the timing of the data influenced (Resign, Eqiupmeot and 
human resources data relevant to 'the development of the maintenance -equipment of an ^r-to-ground 
missile were presented to eight experienced design engineers. The subjects were required to develop a 
conceptual design of the equipment. The expenment contrasted the simultaneous presentation of all human 
resources data inputs at the start of design with the same inputs presented incrementally thfoughoivt design. 
The investigation also contrasted manpower quantity constraints with skill level constramts.. . 

It was found that th^ ^ount and timing of human resources data inputs do exercise some influence 
on'the en peers', design The type of requirement imposed (skill level versus quantity cpnstraihts) made a 
difference to the engineers. Although the inputs are responded to by engmeers piimanly when .those inputs 
are phrased as design requirements, informational data (task, and ume-bne /analyses) created an attitude of 
awareness in the engineers of persormel requirements.^ The engineers developed their designs xjuickly and 
resisted attempts to modify their designs. The results indicated, again, that if human resources data are to 
be incorporated m^ajesi^, the data must be supplied at the start of design, and they must be phrased as 
design constraints. ^^^-^ • 



Third Study 



The tbfd study (Meister, Sulhvan, Finley, &. Askren, 1969h) waj^Souducted to investigatcthe design 
engmeers concept of. the relationship between'^ system characteristics andvper«onnel skill. This was 
undertaken because the earlier studies had shown that personnel skill was a potentially powerfuPdesign 
constr^airft. y^t^engineers had little knowledge of the nature of sjiiil, or howit;shoul^ be translate(| into 
uTidw^re clfaracteristics. Fouitecm^ paper and pencil tests, speafically developed^ to examine the 
relationships between skill and design, were ylnunistered (o eight experienced design engmeers. 

h was found that certain design charaotenstics are significantly related to skill levd. These are. test* 
p^^ints, internal components, checkout and troubleshooting jirocedures, type of^test equipment required, 
and go/no go dispUys Individual design concepts suclj as component repair are "^related to the amount'of- 
training required. It was also found that enginc^ers conceptualize maintenance skill in terms of knowledge, 
troubleshooting ability, and flexibility. A common denominator of the skill parameters appear to be 
troubleshooting ability Skill leyel appears not to be related, in the cngin(fer s mind, tayears of experience. 
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Transition 



At this point It seemed as though enougli research data were available to justify the recommendation 
that personneLquantity and skill level requirements be imposed on the engineer as a design goal. However, 
further analysis revealed a number pf reasons why this a[5proach wouM .probably not be used. A major 
reason was the resistaitce by engipeerf and managers to the concept of manpower as a design goal. 
Alanpower as a tiebreaker when all engineering factors are equal, yes, but manpower as a dominant^ design 
goal, no Another rea.son was technical. It was found that m order to inlpose this type of design constrain 
It would be necessary to predict the nature of the military work force which would be available at a da 
some 5 to 10 yeafs in the future. No capability existed to make suth predictions. Therefore, consideni • 
these kinds of reasons it had to be concluded that i( was not feasible to impose personnel factors as desii 
f constraints . - ^ - 

A new^ntry point to engineering design \yas required. Further investigations of the design process 
•cstjfhhshed thot trade off studied were a significant part of design, the appealing- part of trade off studies 
seemed to be that they could accept personnel and tfaimng data which compatedfthc relative effect gf 
several design alternatives, as opposed to requiring absohite statements about manpower design goals for a 
single design Design trade off studies'appeared to be a good entry point for human resources data., 
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Fourth St^d^y "^"^ \ 

The fouFtii stiuly~TtaTrtiJT~Askreii^_<^^ ^ 
process tu deterrruTie the feasibility of jncludinghujrtiaTT- 



^the engmeermg^de's^gn trade study 
ataln-Uade studies. Tliis "re§jbarch also 



>4yzone compleU,^ trade 
ieirnine the 
coruainmg'erigineertng- 
cxpelimQed design 




attempted tu learn sumething about how engineers perform design tra 
studies from actual aeronautical, niissile, and command and control systemsj 
characteristics of system desrgrUmde studies. Four siniuUted.air 
and human* resources data, were consTmteilJor 
engmeers performed the simulated trade studies. ^ — .^.^^ 

It wals found that engmeers can and do use human resoura?~'d:aUi4n^^s^m^^^ u^e studies. 
Personnel costs and, manpower .quantities were assigned more weight in the traie stu^^^han skiH-Jtypes, 
skill levels, and availabihty of personnel. A detailed pre senta tion of human resources Jatuls;:giYen ihore 
weight than a condensed pres^entation. Human rcsOujces data should be presented to Jhe cngi ^ 
quantitative units familiar to the engineer to be most i^e<ul. The four major sources of variabihty ift trade 
study results were found to be choice of evaluation paramct^, value weights for the paranu^ters, methods 
of normalmng the parametnc'data., and methods of combining paiwietnc data and weighting factors. 

Formal Trade; Study Limitation , 

WTule conducting the fourth study it was leanjed that only^a small portion of design tFade offs are ^ 
made pubhc via .formal, documented trade studies. The high percentage df trade offs are informal^ 
comparisons of alternatives, andcare not documented, except possibly in notes by the engineer for his own 
use. Consequently, the engmeenng psychologist is.not bkely tb be aware of many of the design trade offs 
. that are performed. Realizing the potential value 3f the design trade off as an input point for human 
resources data* an attempt^as made ta develop a method to identify , m advance, the numerous trade offs 
that woulci be m^de dunngl design of a product*. Such a method Nvould enable the engineering psychologist 
to anticipate design trade offs. and to arrange for mclusion of human data in the.more critical ones. 

Fifth Study 1 * ' <' ' ' 

Tlie fiftli-study (Askren &Korkan, 197 1 . Askren & Korkan, 1974) w^ perfomied in resppnse to this 
need. The result was development of-the 'design option decision tree (DODT) method. The DODT is a 
graphic means of depicting the sequence of engineenng decisions required for resolution df a design 
problem-. Tlie DODT also descnbes the design ojptipns available ^t each decision point.* 

In this study, the DODT concept was teste^on aircraft propulsion and flight control subsys terns. "The 
lesulting DODTs were' evaluated by eight engineers e?f>cne need in designing these specialized areas of 
aerospace systems. It was found that the DODT is a feasible and' vahd method for anticipatmg and 
dcscnbing system design trade offs. . ' | " 

Sixth Study ^' ' . J ' 

.The sixth study (Askren. Korkan & Watts, 1973) was conducted to explore the feasibility of 
developing design optiuii decision trees to a level of detail which shows hardware involved in maintenance 
operations, and to measure the'serisitivtty of different types of human resotirces data to different design 
trade off' problems depicted in these trees. This study also tested the feasibility of using psychometric 
scahng methods as a means'bf generating the data, wluch descnbe the impact of trade off alternatives on 
the human resource factors, ' ' * . t - 

Tlie approach included expanding a portion of the DODT developed for the aircraft jet engine in the 
fifth study, selecting trade off problems from the expanded tree for sensitivity analysis, and collecting^ 
psychometric data Uum expenenced jet engine rnechaniis regarding this ^sensitivity . It was found that 
F^ODTs^can be developed to tfie maintenance level of detail. It was also fotmd that the factors of training 
and CxpenffTTDTj^ amount of maintenance time, wid ease of maintenance were most effected by choice of 
design options m the trade off prublen^. Complexity of tools, crew sjze, and job speaalty were effected* 
less. It was also found to be feasible to use expenenced maifiten'anoe technicians as raters to make 
evaluations of the impact of design alternatives oj the humart re&biirpes factors. * 



Seventh Study " . . - * ■ * 

l\\e seventh study l^)"".^) was conducted to deternune' the capability of engipeenng 

psychologists to respond m a timely 'maaner and with realistic data to an actual design tr-ade off problem 
This stud> alsu (^xpk>rcd further the itsc of. ps> chometnc scaling techniques as a means for generating the 
dat-a which measure jhe effect'of design alternatives on human resources. ^ , " 



Mr 



Hie trade lilf.problom con^.'cmed the selection of an'electTical unit for a new aifcraCt undergomg^ 
development Three design alternatives vvere evaluated as t« impact on , the number and kind of 
maintenance per^unnel required lu inspect s\d repair the electntal unit, type and amounL<)f tramijig for 
these personnel, the tune required'to perform tlie maintenance work, afrd^the dt^llar cost to provide the^'e 
pei:$onnel fur tht life of the i,Nstcin The data descnbmg the Mnpact of t]ie three design Ultematives upon 
il^e hunlan resource^ iaciurs were colkxtcd from Experienced aircraft maintenance techiiiaans usmg 
^ psy chometnc scaling techniques. ^ ' * * * - . . " 

- ' , ' * * , ^ . ' 

It ^ Was touiid that these tv[)e> u|- IjumaTi resources dala* could be generated far the three desigi^ ' 

alt^iativcs^.in a timely rashioi;^ for enginecnng ase - It was-also foimd, again, that it is feasible to use 
experienced niami^cnan^e pcrionuel as raters to make ludgmehrs about the impacf o.f design j^tematiyes on 
huiBaii rcs'ourcc tactMrs hi ad^ditiun. further developments were made m the psychometric procedures 
ne&ded to Collect the (.lata 

' ^ ^ " \ , 

Eighth St udv* ' . * - • 

The eighiKstud\ (Whalen & Askron, 1*^4) was undertaken tt^ accomplish twu objectives. Tlie first 
nhjCLtive was to identifv and classify the charactenstics of cona^ptual design trade studies thatliave high , 
[^KUenjial impact up human resource requirements of Air Fixee weapon s>stems Tlie approach, used was a 
Case histwrs' review and anaUsis ot 12'^aKcrafl design trade studies Tlie analysis indicated iliat the avionics 
>vstein has the greatest potential impav.t on human resourLCs It was also lound that trade studies dealing 
with design*altemative> that eruompass widely differt-m technologies have substantial irnpact on hum.in- 
rcsoura^s. Fhc t\t>e. i human resources data (HRD) ninst intTiienced b\ alternative design/)ptions were 
maintcnaiKc task times atur^vrsomicl u)Sts Hie sci^ulid sHidy objective was to determine the accuracy ut 
using suhKMive cstitliates a technique for dcrnniL the \ ffiD impact oi trade studv options. Using i)nlv 
engineering rritoimati'^ri inr si\ a^t^'ni^s sub>v steiiLs. Irom the uMia^ptua! <.ksign phase, Au P\)rce 
mamtenafKC tc^hnKian> nude ^.u^mCl tivc ostiniato^ ol the impact v\ the desipis on selected MRL) items. It 
A as tnund that teJuikMus uin imkc iLa^onabK a^cuiate estimates of the amount of time, the Air forv.e 
"L^^upathnul spe.jaltv, tfio !ovol ui tL-JmiCal skill ind the number td {xnsonnel needed to fxniorm field 
main ten an a' t as>^ 



III IMl ( rkVlIONOI RI SU IS AM)( ()N( LI SIONS 

Iho tiiuinuN irum tlu' tosearJ>\ repotted ahnvo are oigam/ed arumul six topics feasibility and 
pracM^alitv i»f uMiig human rcsiairu's dXa as i^ritena m engineeriiii! design methods lor usmg the data in 
design studies: ettcit on the vtem id uMnullio data as desiiJii Lriteria. ty|Vs ot human resources data mo.st 
lelev.ml H' ise isdcsh'ii vfileiia ihcdoKls tor L!cnc"iaimg iiuman resources data tor use in design studies, and 
nature ot the LMi 'meiom,^ doM.'n pi ^css I hcse integrated results arc tiiv en m the toll owmj: sections 

leaMhihtN ot Human Resonrees Data as pesign C rilena 

_ Hio 'Hcmdim: hiivlni ^ ihmih^luuit all o! the icseaiJi has bceiijhe tea^ibilitv and practicality ol using^ 
hunum rcsouices dati'is .riteria m eugmeennu' Ocsum" studie'^^J^uantdicatum ol the data is possible, 
ljii:incef^ ^H'-epi the d^ttt- hip^ut ut tlie iksign pro^ess-Mre available And the quality of the human 

data h otteii a> gcnd as iho qualitv n| the enuinee rin^' data, espcLially m earlv Lon(.x?ptnal design studies 

» 't ♦ 

Methods for Using Human KesoutpK Data'in [)esign Studies 

Huunui res'JUfies data luav be ukorporated Vn design priKcss by at least iwn means as design 
ouistraints. and as decision parameters in desi(?n (rade ofts Tlie trade ott use ol luimair resources data has 
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tht\-grcatqst probability if i^uccci^sful appLcation at this tinie.' In the future, given better techntyues for 
predicting the nature of ihanpower forces be available, the desigi,i constraint methocf could be a powerful 
ineansof-ihfluencmg the-piaractensticsof ecjuipment. ; ' > • / ' * ' 

■ Effect on^t he System of HuMari Resources as Design Criteria - ' . . 

Based on the studies reported above, it is anticipated that the effect of human resources design 
critena on the s>stem wutild range from moderate for a large per cent of design studies in which the d?rta 
are "used, tu great effect in^a small per cerit of design studies. As found in the fourth study, it is probable 
that human resour^^e cntena data will have their greatest effect wh^n-actirig in combination with other 
engineenng and operational requirements data, rather than as a single controlling factor. " > 

Typ^s o& Human Resources Data Retevant to Design Studies • . . ^ 

A v^ide vdjicty- 0f human resources data were found totbe useful as cntcuia in design studies. Th^s 
incitu^£c^jjdjij[5^^ s>kill level, technician job specialty, pej^onrlel dollar 

tubt, tvpTlmdj^oim^ time* job difficulty, and personnel lumover rate#The 

^i\th s/ud) fuundUiTr^teliAg^f^ relevaftijo a par^titular .design problem is a function of the nature of 
the dtisign prk^l/lem. ^l'htinuQ^S^a:§^jdata^ not apply tu all dcfsign studies, h is cntical to provide fhe* 
engineer with data that is most relev^-. 



P Methods for Generating Human Resources Criteiia'Data ' / 

.Tliree. me thuds for generating human resources data f^or use as criteria in design studies were 
'examined dunng the course of the research. These methods were, (a) mathematical and computer 
simulation mudels which predict the effect. of design on human resources, (b) hist oncal, documented data 
wlHch show relations between design, tharactenstics and human resources, and (c) the use of psychometfic 
:>Lahng technique^ and subject matter experts to give ratings of the impact of designs on the human resource 
factors J^ien consideration was given to the use of data dunng^early, conceptual design studies, generation 
nf the data on a timely basis, and low cost^ developing the data, the psychometric seal mg technique was 
selected for more' intensive investigation. This was fgund.to be a viable method. Three studies attest to its 
teasibiht/' and vaLdity. It was found that the judges respond to the, rating task irt a senous manner, that 
tjiey are able to make judgments for a wide spectrum uf hoiojan resource factors, and the validity of their 
ratings appears adequate for use in design studies. * ^ ^ 

Nature of the Engineering Design Process 

Two views uf the design process^have emerged from tins research. One view descnbes design as an 
artistiL rendenng, in which ,the engineer receives ar dcsigiT problem, acknowledges constraints, and then, 
drawing on Ins uwn personal expenences, works very .cjuickly to develop a concept. The other vievy 
descnbes design as a human deasion process in which the engineer methodically makes a senes of design * 
lIuulCs \\c follows a path from'design problem to design product. Along the path he makes judgments 
.ihuut th(^ iharatteristics of the product he is dpsigmng. Many times he will face choice points with options 
to choose between. 

Wl]ich process will a given engineer follow for a given design prol^lem"* The answer seems dependent 
un a number of factors sach as the training of the engineer, his personal styj£t the nature t)f the design 
problem, time available to Lumplete the design t a.sk^ an4jA2rn{ia^^ design philosophy. It is 

hoped to 'address this question in future research. ^ " 



Conclusions •-^ 

\ V V 

It is teasible to include human resources data astnNmain engineean.^ design, an4 it iJ^xpected thpt 

the data wilF affect the design product. Human resources dat^rnay be incorporated in the design process, as 

uinstraint^s, ur as deasion parameters in'trade offs. Tlte trade ofNmethod is preferred at this time. The trade. 

uffs tu he performed dunng the design of a new sy.^teni tan be antli^patcd, using the design oplior) decision 

tree method, and the more tntital trade offs identified. A vanety ofsjiuman resources data are iis^ul in 

'design studies, with the nature of the design, problem dictatinj the p^Ucular dat^i. Valid da^a cafTi^e 

generated in a timely manner using psychometric scahng techiiiques amSjudgments of subject .matter 

experts. Tlie engineering design process itselCis amenable to study, with beneficed resutts to both improved 

use of human data and greater knowledge of the naturejjidesign. 
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Wliat next fur tins area of Kbearch'^ The need is for aii effort whicJi puts all the findings together into 
a single teciinoiogical package, fullwwed by a demonstration of their practicahty, acceptability and value in 
an ongoing en gineenng design progran>. h is hoped to perform such a test in the near future. 
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